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ABSTRACT 

Few states have overcome the political and practical 
obstacles to implementing a clear, feasible, comprehensive accountability 
system. The University of Washington’s Center on Reinventing Public Education 
reviewed experiences from state accountability efforts. Workable 
accountability systems focus on results, clarify goals and roles, and 
appreciate reciprocal relationships involving schools, districts, and states. 
No state has yet coordinated all seven of the following essential elements of 
an effective system: (1) fair, reliable, relevant, and understandable 

indicators; (2) predictable performance incentives; (3) opportunities to 
build school capacity; (4) flexibility for schools; (5) safety nets for 
students; ( 6 ). comprehensive public information campaigns; and (7) an 
independent oversight body. The reward-and-penalties approach often fails 
because though schools may want to improve, they lack necessary resources and 
knowledge. State attempting to implement these seven elements should consider 
10 essential recommendations: (1) keep performance measures simple; (2) look 

for patterns in numbers; (3) use rewards to accomplish multiple goals; (4) be 
strategic with scarce resources; (5) focus on the student needs; (6) ensure 
school-specific assistance; (7) offer schools broad flexibility; (8) be bold 
and steadfast; (9) recognize the importance of public perceptions and 
educator morale; and (10) create checks and balances on accountability 
politics. The Strong Schools Accountability Model works only when incentives 
fir performance are meaningful, properly balanced, and schools have the 
capacity to respond to them effectively. (Appendices provide information 
about five study states and technical details regarding the Strong Schools 
Accountability Model. Contains 93 references and URL addresses for Department 
of Education Web sites from all 50 states.) (TEJ) 
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Preface 



Accountability in Washington State: 

In the spring of 1999, the Washington State Legislature passed ESSB5418, which created 
the outline of a statewide accountability system. The state’s 1993 Education Reform Act already 
committed the state to set standards for student learning, create a statewide exam (the WASL) to 
assess student progress toward these standards, and develop a system to hold schools and 
districts accountable for student performance. ESSB5418 offered the specific guidelines for the 
state’s accountability system and created the Academic Achievement and Accountability 
Commission (AAA Commission) to provide “oversight of the state’s educational accountability 
system.” 1 



The AAA Commission — nine members appointed by the Governor with nominations 
from each party — has been charged with making recommendations for student and school 
performance targets and setting criteria for identifying schools in need of assistance, 
interventions, or recognition. In addition, the Commission is expected to make 
recommendations on the types of assistance, interventions, and recognition that the state 
education department should make available to qualifying schools. 

The Commission’s charge is an important and potentially daunting task. Washington’s 
Commission does not face its problems alone, however. Nearly half the states nationwide have 
already designed or are in the process of developing elements of standards-based educational 
accountability systems. 

The University of Washington’s Center on Reinventing Public Education recognized that 
lessons learned from other states’ experiences could be of use to Washington’s AAA 
Commission. In addition, other states attempting to build school accountability could also 
benefit from an analysis of the challenges and successes of implementing effective accountability 
systems. 

Thus, in the fall of 1999, the author initiated a review of efforts across the country, and 
specifically in five states, to introduce performance accountability into education reform 
strategies. This paper is the result of the Center’s analysis and serves as an extension to a 1997 
publication from the Center, “Toward a K-12 Education Accountability System in Washington 
State,” which provided a general framework for creating a state accountability system. The 
current research was undertaken with two primary goals: 

• To identify lessons learned from other states’ experiences with designing and 
implementing accountability systems and, 

• To use these lessons to create a model for an accountability system that a state like 
Washington could use as a starting point. 2 

To meet these goals, the author conducted a literature review of states’ efforts in 
accountability nationwide. The review included existing academic research and general analysis 
from Education Week and the Education Commission of the States. It also included a closer look 
at the lessons learned in five specific states: Texas, North Carolina, Kentucky, New York, and 
California. 



1 ESSB5418: for text see http://www.leg.wa. gov/pub/billinfo/1999-00/senate/5400-5424/5418-s pi 04241999.txt. 

2 The recommendations presented in this paper are targeted toward the needs of and current conditions in 
Washington state. These conclusions and findings may, however, be of interest to leaders in other states. 
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While five states’ experiences represent a relatively small sample, this subset includes 
many of the states that, by reputation, have been most active to date in developing full 
accountability systems. Nevertheless, the analysis in this paper is not intended to provide an 
exhaustive description of all states’ experiences with accountability. It is designed, however, to 
offer Washington state planners and others the benefit of lessons learned by others, and to 
formulate issues that can spark productive discussion. 

About the Proposed ModeU 

This paper’s proposed accountability model, described in detail below, merges elements 
of different state accountability strategies that seem to be working well and fills in some of the 
remaining gaps with ideas that hold promise. Because each state and its political community are 
different, the proposed model cannot be the only plausible approach to accountability. The 
model does, however, offer a promising approach to accountability— one that promotes school 
improvement via a unique mixture of assistance, incentives, and school autonomy. It departs 
from the traditional rewards-penalties focus of accountability systems, incorporating strategies 
intended to build school capacity while ensuring that no student is left to flounder in a school 
that cannot improve. 
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Executive Summary 



Introduction 

Accountability is one of the latest buzzwords to sweep through K-12 education. Across 
the country, states are setting standards of learning for all students, creating assessments to 
measure progress toward these milestones, and talking about holding schools responsible for 
academic performance by rewarding successful schools and sanctioning those that fail to meet 
expectations. Yet, as some observers have noted, the “rhetoric about accountability often 
exceeds the reality.” 3 

While 48 states use assessments to measure student achievement, only a handful have 
created a comprehensive system for holding schools and districts responsible for the performance 
of their students. 4 Creating a comprehensive accountability system is politically and practically 
difficult. States must develop smart, clear, and politically feasible strategies to implement 
accountability systems effectively. Anything short of this will relegate the potential power of 
accountability — ensuring all students have sound learning opportunities — to nothing more than a 
soundbite. 

Accountability need not be another fad dismissed when the next great reform idea 
emerges. States on the verge of creating an accountability system, like Washington state, can 
learn from the experiences of their peers and build an effective and enduring accountability 
system. While a strong accountability system will not transform public education by itself, it is a 
necessary first step in building an educational system organized around high expectations for all 
students. 

The University of Washington’s Center on Reinventing Public Education recognized that 
states like Washington could learn important lessons about creating and implementing 
accountability systems from the pioneering experiences of others. 5 Thus, in the fall of 1999, the 
author initiated a review of state accountability plans from across the country, emphasizing five 
states: Texas, North Carolina, Kentucky, New York, and California. 

The Center also sought to weave lessons from other states into a coherent model for a 
state accountability system. The Strong Schools Accountability Model proposed in this paper is 
the result. 

Necessary Elements Of_An Effective State Accountability, System 

States’ experiences reveal three principles that underlie any workable accountability 

system: 

• Focus on results. The mission of an accountability system is to assure that all students have 
access to schools that will help them learn, as evidenced by their ability to meet state 
standards of achievement. Measurement, rewards, and penalties are not goals, but means. 
The goal is effective schools and learning for children. 

• Clarify goals and roles. The state must be clear about what such a system can do and what it 
cannot do. A state-run accountability system alone cannot identify all the intangible aspects 
that make a school “good,” nor can it single-handedly transform public education. 
Accountability, when implemented thoughtfully, can create the conditions within which 



3 Jerald, Craig D. and Ulrich Boser, ‘Taking Stock,” Education Week, Quality Counts 1999, January 1999, p. 81. 

4 Education Week. “Quality Counts ’99: Rewarding Results, Punishing Failure,” Vol. XVIII, No. 17, January 11, 
1999. 

5 The recommendations in this paper are targeted toward the needs of and current conditions in Washington state. 
These conclusions may also be of interest to leaders in other states. 
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schools focus on student performance and are supported in their efforts to do so. This is an 
important first step in transforming our educational system. 

• Recognize that accountability is two-way street. Accountability must be seen as a reciprocal 
relationship — one in which schools, districts, and the state all have important roles and 
responsibilities . 6 The reciprocal nature of accountability means that a state cannot simply 
demand performance from its schools and districts, but rather must provide them with 
resources and freedom of action so they can improve instruction 

Based on these principles and the analysis of other states’ experiences, this paper 
identifies seven key elements of an effective accountability system : 7 

• Fair, reliable, relevant, and understandable indicators of school performance; 

• Predictable and consistent incentives or consequences for performance; 

• Opportunities for schools to build their capacity, ensuring tools and resources for schools 
that need to improve; 

• Flexibility for schools to adapt to help their students learn and meet state standards of 
performance; 

• A safety net, providing functional learning opportunities for students when school 
improvement is not possible; 

• A comprehensive public information campaign that helps schools and the public 
understand the process; and 

• An independent body guiding the system and providing checks and balances on the 
political oversight of the system. 

No state has yet coordinated all seven elements into a coherent accountability system. 
Some states, however, have come much closer to doing so than others and can offer valuable 
lessons in how to implement these elements. This paper uses this seven-element framework to 
present findings and recommendations from other states’ experiences and to offer the details of a 
new model for accountability. 

Accountability In Other States: FindingsAjld Lessons 

Nationwide, accountability remains a work in progress. Most states struggle with 
creating clear but fair indicators of school performance. Many are still searching for the right 
mix of performance incentives to inspire improvement without discouraging those with the 
toughest problems to solve. States, in general, have also not yet figured out how to build school 
capacity and create a safety net assuring all students a functioning learning environment. Most 
are still working on ways to ensure that schools have the necessary freedom of action to make 
needed changes in staffing, use of time, and teaching methods. And, few states have been able to 
get out in front of public fears about accountability with a public information campaign that is 
clear, accessible, and meaningful. Nevertheless, states like Washington can learn important 
lessons from the struggles and successes of others. 



6 See Richard F. Elmore, “Accountability in Local School Districts: Learning to Do the Right Things,” Advances in 
Educational Administration, Vol. 5, 1997, pp. 59-82. See also, Allen, Lauren and Anne C. Hallet, “Beyond Finger- 
Pointing and Test Scores,” Cross City Campaign for Urban School Reform, 1999. 

7 This list is an expansion of the key elements described in the Center’s earlier report: Hill, Paul T. and Robin J. 
Lake. “Toward a K-12 Education Accountability System in Washington State,” UW/RAND: Center on Reinventing 
Public Education, December 1997. A more recent version of the report is available: Hill, Paul T. and Robin J. 

Lake, State Standards and School Accountability, Washington, DC: Brown Center on Education Policy, The 
Brookings Institution, 2000. 
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States have tended to rely on a rewards-penalties approach to accountability. This 
approach presumes that schools will accomplish more, do better, and work faster when there are 
strong incentives for doing well and strong consequences for falling short of the mark. Some 
states have created “rewards,” often in the form of financial bonuses, to increase schools’ 
incentives to perform well. “Penalties,” in the form of interventions like reconstitution and 
takeover, are threatened to deter poor performance. This approach fails to recognize that some 
schools may want to respond and improve, but lack the resources or capacity to do so. In these 
instances, an accountability system must provide more than simply incentives and consequences. 
It must also provide opportunities for schools to build their know-how to help students improve. 
Some states are starting to recognize this oversight in the rewards-penalties approach and are 
making mid-course corrections to remedy it. 

Key Recommendations for Washington and Other States: 

The main body of the paper next delineates a series of recommendations for Washington 
state and others to consider when implementing each of the seven elements. Ten of these 
recommendations are listed below. These suggestions, gleaned from lessons learned in other 
states, are offered as essential foundations for an accountability system that will help schools 
improve: 

• Keep Measures of School Performance Simple: Indicators of performance that are clear and 
easy-to-understand minimize misunderstandings about what is being measured and send 
strong signals about what matters. Complicated formulas and mathematical indices of 
performance may attempt to capture the complexities and nuances of education, but no 
amount of mathematical sophistication can measure many intangible aspects of learning. 
Instead complicated performance measures can leave schools and the public confused about 
what is actually being measured. 

• Look for the Patterns in the Numbers: The most effective indicator will keep clarity as its 
driving principle, but will offer multiple layers of performance data to attempt to find the 
patterns in the numbers. The intent of an indicator system is to identify schools that 
consistently show the need for assistance or intervention or that consistently show the ability 
to exceed state goals. 

• Use Rewards to Accomplish Multiple Goals: Typically, rewards are simply distributed to 
schools. Other schools do not have the opportunity to consistently learn what the recognized 
schools were able to do differently to inspire such change and success. This is a real missed 
opportunity in existing accountability systems. Rewards can be an opportunity for successful 
schools to mentor or link with other schools to share best practices. 

• Be Strategic with Scarce Monetary Resources: When rewards carry high financial stakes, 
they represent, in effect, a transfer of funds from schools that need assistance to schools that 
are already succeeding. With limited resources available for educational improvement in 
most states, such a transfer can be hard to defend. 

• Stay Focused on the Needs of the Students: In light of the challenges of school closure or 
reconstitution, states may be tempted to continue indefinitely forcing assistance into deeply 
troubled schools. This approach can lead to unlimited delays, dooming children to more 
months and years in schools that cannot teach them well. States must not lose sight of their 
first responsibility, which is to meet the needs of students, including those in chronically low- 
performing schools. An accountability system must have a strategy for helping schools 
improve and, when necessary, creating functional learning environments for all of its 
students. 

• Ensure that Assistance is School-Specific: Building real school capacity requires on-site, 
school-specific assistance. Every school is different, as are the problems and challenges they 
face. The assistance and capacity-building they need, therefore, will vary. Providing the 
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range of assistance that schools require will necessitate a broader variety of assistance 
providers than any state can offer directly. Accountability systems that do not provide 
options to tailor assistance to the needs of the school and that do not support a variety of 
assistance providers able to meet these needs, miss a valuable opportunity to help some of the 
most dysfunctional schools and may indeed end up wasting money and time by giving 
schools assistance that does not address their specific challenges. 

• Offer Schools Broad Flexibility: Schools must be able to make decisions about key inputs 
like instructional materials, financial resources, and the use of outside consultants or 
programs, if they are to feel accountable for the performance of their students. 

• Be Bold and Steadfast: Creating an accountability system that consistently focuses on the 
needs of students will require making hard decisions about redesigning or transforming some 
chronically low-performing schools. The system will be under intense pressure at times and 
will need strong political tenacity and a clear commitment to the principles of accountability 
to endure and have an impact. 

• Recognize that Public Perception and Educators’ Morale Matter: Accountability systems 
presented with an adversarial tone and a lack of clarity are more likely to create 
defensiveness than progress. A thoughtful public information campaign, communicating a 
clear accountability system with understandable school performance indicators and a mission 
that focuses on supporting, not punishing, schools is an important key step in building public 
trust. States that are interested in building school capacity and treating accountability as a 
reciprocal relationship — one in which the state, districts, and schools work together to help 
students learn — will need a clear strategy to overcome preconceived beliefs about the intent 
and goals of accountability systems. 

• Create Checks and Balances on the Politics of Accountability: An independent guiding body 
focused solely on accountability should work to minimize political influences so that it can 
serve as a stable voice and allow the system time to show improvements. 

A comprehensive model of a state accountability system based on these principles is 
described in Sections IV and V of the body of the paper. The Strong Schools Accountability 
Model is grounded in the belief that accountability will only work when incentives for 
performance are meaningful and properly balanced and when schools have the capacity to 
respond to them. The model is built on the seven elements of an effective accountability system 
and is offered as a starting point for discussing accountability systems that can incorporate 
strategies to build school capacity while ensuring that no student is left to flounder in a school 
that cannot improve. 
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Section I: Introduction 



In the decades since A Nation at Risk warned of a “rising tide of mediocrity” in American 
schools, states and districts across the country have searched for the secret to improving 
performance. 8 No one has yet found a silver bullet. Many states, however, have identified one 
essential ingredient: holding schools accountable for student performance. 

To be accountable, in the most basic terms, is to be held responsible for something. 
More specifically, researcher Anthony Bryk notes that a more complete definition of 
accountability requires answers to the following three questions: 9 

• Who is responsible to whom for what? 

• How will evidence be gathered and used to determine if these responsibilities are being met? 

• What are the system responses to those who do or do not meet these standards? 

Accountability in Public Education: The Theory, end Reality 

In the 1990s, states sought to answer these questions by saying: (1) schools (as distinct 
from parents, or individual teachers, or entire school districts) are responsible for student 
learning and that the state government is the party to whom schools are accountable; (2) 
evidence of performance would be gathered by the state via specially constructed achievement 
tests; and (3) state agencies, including school districts, would respond to school performance by 
rewarding effective schools and sanctioning or intervening in ineffective ones. 

Though these broad answers left much unresolved, they did signal a new focus on 
results. Historically, schools and districts have been accountable for the inputs of education (i.e., 
whether the school provided instruction for 180 school days, whether the teachers met basic 
licensure requirements, whether specific subjects were covered in the curriculum). In contrast, 
the accountability movement that continues to gain momentum puts the focus on outputs (i.e., 
whether students are learning to read, write, and understand mathematical principles). 

Today, in public education, the term accountability has taken on a very specific 
meaning. It refers to state-driven systems designed to hold schools and districts responsible for 
supporting and furthering student learning. Such accountability systems typically have followed 
the theory of action presented in Figure 1 . 

Figure 1: Common Theory of Action for State Accountability Systems 




This approach is based on the theory that measurement, publication of scores, and 
rewards and punishments will inspire schools to accomplish more, do better, and work faster to 



8 National Commission on Excellence in Education, “A Nation at Risk: The Imperative for Educational Reform,” 
Washington, D.C. : The Commission : [Supt. of Docs., U.S. G.P.O. distributor], 1983. 

9 Bryk, Anthony S. “Observations About the Productive Uses of Assessment to Strengthen High Schools,” Remarks 
prepared for the Transforming Secondary Education Conference, December 6-7, 1999, Kirkland, WA. 
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help their students meet state standards. But it is very hard to make what looks so neat and tidy 
on paper actually work in practice. In the real world, the number of ways in which this theory of 
action can come undone are almost limitless. For example, even with the best will in the world, 
schools may find themselves unable to change simply because they do not know what to do, seek 
assistance based on the latest fad of the month, or find themselves hamstrung by state regulations 
or staff turnover. The result is the same: nothing really happens. Moreover, the theory of 
standards-based reform can fall prey to schools that have little incentive to pay attention to the 
standards. Recent press accounts indicate that anxious teachers and principals may also sabotage 
the standards by, in effect, cheating on the assessments. Again: no change results. As Figure 2 
below describes, these developments march in tandem with the official version of how change is 
supposed to occur and may thwart what state and local policymakers had in mind. 

Figure 2: The Common Reality: Nothing Happens 




An effective accountability system must anticipate and plan for the real and complex 
world of schools and school systems. It cannot rely on an overly simplistic notion of school 
change. Instead, in order to reasonably expect schools to impact student performance, a 
standards-based accountability system must: 

• Provide meaningful incentives that lead schools to take the standards and assessments 
seriously; 

• Ensure schools have access to a variety of qualified external assistance providers when 
they may not know what to do to improve; 

• Give schools the freedom of action to do what they need to do to help their students; 

A standards-based accountability effort can lead to real school change and the potential 
for all students to meet state standards when it is crafted and implemented with these tenets in 
mind. These lessons will be reinforced in this paper’s analysis of other states’ experiences with 
accountability in Section III and in the Strong Schools Accountability Model proposed in Section 
IV. 
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BEST COPY AVAILABLE 



State Accountability: A Necessary but not Sufficient Means to School ImprovemeM 

The emergence of accountability for performance is an important tool in helping public 
education keep focused on its primary goal: supporting student learning. Accountability puts 
students and their learning in the forefront of policy-making decisions and ensures that no one 
loses sight of their needs, even while coping with the day-to-day complexities of school 
management. 

State-level accountability systems are an important starting point for creating a public 
education system that is equipped to help all children learn, but policymakers and the public 
must recognize what a state-level accountability system can do and what it cannot do. 

State level data and analysis about schools and districts is naturally limited. For the 
most part, it can only reveal, for example, whether students in a school are meeting or 
progressing toward state standards. Data from state-administered tests and other indicators of 
performance that a state could reasonably gather cannot reveal whether a school provides a 
caring environment for students, creates a love of learning, maintains close home-school 
relationships, effectively teaches materials not covered by the test, or is a good place for serious 
professionals to work. Nor can test data alone reveal whether school staff have a good strategy 
for improvement or are simply coasting. Making such determinations is complex and often 
subjective. No state data collection system could ever effectively gather and analyze such an 
intangible and ultimately subjective determination of a school. 

Given these limitations, a state-level accountability system must have a clear focus on 
ensuring progress of all students toward state standards of learning. It must also leave room for 
parties other than the state government — e.g., parents, teachers, neighbors, local district leaders, 
employers, and other schools that receive the school’s students after they graduate — to develop 
their own accountability relationships with schools. When parents have the ability to choose 
their child's school, when districts have the will and capacity to monitor school performance by 
actually observing the school in action, when external organizations take the initiative to track 
some of the more intangible aspects of school performance, and when a state keeps its eye on 
student academic achievement — then a school faces real incentives and pressures to meet all of 
the needs of its students. State accountability systems cannot and should not do this alone. 

Moreover, a state that wants schools to improve must have more than an accountability 
system. Improving student performance, for example, requires a highly qualified and motivated 
teaching force and strong school leaders. State policies to sustain and improve the supply of 
quality teachers and school leaders are essential complements to accountability. Similarly, state 
policies that free schools from unnecessary regulations are also necessary to the success of 
accountability. Schools that have little or no control over their budgets, instructional day, and 
staff, will not feel accountable for the performance of their students. State accountability and 
these other factors complement one another: none, however, can create more effective schools 
all by themselves. 



Rogdmgpjor this Paper 

This paper is divided into five primary sections: 

• Section I has introduced the ideas and challenges facing state accountability systems. 

• Section II provides a framework delineating this paper’s definitions of the necessary 
elements of an effective accountability system. 

• Section III provides an overview of approaches to accountability taken by other states to 
date, with a focus on five states (Texas, North Carolina, Kentucky, New York, and 
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California) that have developed relatively comprehensive accountability systems. It 
compares their efforts to the definition of necessary elements of an effective system and 
offers a series of recommendations for Washington state and others to consider in developing 
an accountability system. 

• Section IV offers a possible model for a new state accountability system — created by 
combining the most effective elements from existing accountability systems with new ideas 
that hold promise. 

• Finally, Section V concludes with a broader consideration of the roles of key state, local, and 
private actors in implementing the proposed model and also explores the possible unintended 
consequences and the conditions necessary for it to work effectively. 

This paper has been written for two audiences. Readers who want to explore more 
information about the basic ideas and impacts of state accountability systems will find Sections I 
through III most helpful. Readers who want a more intensive treatment of accountability issues 
and system design options (e.g., state staff members responsible for the detailed design and 
management of an accountability system, or accountability scholars, etc.) should also read the 
Strong Schools Model design described in Sections IV and V. 
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